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1  Introduction 

This  work  of  this  proposal  is  concerned  with  the  multidisciplinary  field  controlled  active  vision 
which  involves  the  synthesis  of  techniques  from  control  and  computer  vision  to  treat  a  number 
of  fundamental  problems  including  visual  tracking.  Thus,  a  key  theme  of  our  research  is  the 
development  of  techniques  for  using  visual  information  in  feedback  control  systems.  Controlled 
active  vision  is  leading  to  enhanced  man-machine  interfaces  for  interactions  with  computers  and 
more  complicated  systems  such  as  remote  controlled  weapons  and  vehicles. 

Our  work  has  drawn  upon  our  extensive  experience  in  robust  control,  and  the  methods  we 
have  been  developing  for  various  problems  in  image  processing  and  computer  vision  utlilizing  the 
theory  of  geometric  variational  evolution  equations.  These  techniques  have  already  been  applied 
to  visual  tracking,  automatic  target  recognition,  and  problems  in  biomedical  engineering  including 
image-guided  surgery.  It  is  important  to  note  that  many  of  these  methods  were  derived  from 
ideas  in  optimal  control  [59].  In  particular,  the  geometric  variational  techniques  have  been  very 
influenced  by  concepts  from  optimal  control,  and  the  resulting  concept  of  viscosity  solution  is  a 
direct  consequence  of  Hamiton- Jacobi  theory  [33]. 

Vision  is  a  key  sensor  modality  in  both  the  natural  and  man-made  domains.  The  prevalence  of 
biological  vision  in  even  very  simple  organisms,  indicates  its  utility  in  man-made  machines.  More 
practically,  cameras  are  in  general  rather  simple,  reliable  passive  sensing  devices  which  are  quite 
inexpensive  per  bit  of  data.  Furthermore,  vision  can  offer  information  at  a  high  rate  with  high 
resolution  with  a  wide  field  of  view  and  accuracy  capturing  multispectral  information.  Finally 
cameras  can  be  used  in  a  more  active  manner.  Namely,  one  can  include  motorized  lenses  mounted 
on  mobile  platforms  which  can  actively  explore  the  surroundings  and  suitably  adapt  their  sensing 
capilities.  For  some  time  now,  the  role  of  control  theory  in  vision  has  been  recognized.  In  particular, 
the  branches  of  control  that  deal  with  system  uncertainty,  namely  adaptive  and  robust,  have  been 
proposed  as  essential  tools  in  coming  to  grips  with  the  problems  of  both  biological  and  machine 
vision.  These  problems  all  become  manifest  when  one  attempts  to  use  a  visual  sensor  in  an  uncertain 
environment,  and  to  feed  back  in  some  manner  the  information. 

2  Research  Summary 

In  this  section,  we  will  summarize  some  our  key  findings  in  our  just  completed  ARO  contract. 
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2.1  Robust  Nonlinear  Control  and  Causality 

Under  ARO  support,  we  have  worked  extensively  in  nonlinear  robust  control.  Besides  the  theoretical 
and  practical  questions  involved  in  finding  an  implementable  nonlinear  design  methodology,  it  is 
interesting  to  note  that  certain  associated  problems  of  causality  have  arisen  in  this  area,  which  we 
would  like  to  briefly  indicate  as  well.  In  fact,  as  a  result  of  this  effort,  we  have  been  able  to  put  an 
explicit  causality  constraint  in  commutant  lifting  theory  for  the  first  time  [35,  37,  42]. 

There  have  been  several  attempts  to  extend  dilation  theoretic  techniques  to  nonlinear  in¬ 
put/output  operators,  especially  those  which  admit  a  Volterra  series  expansion  (see  [36]  and  the 
references  therein).  Typically,  one  is  reduced  to  applying  the  classical  (linear)  commutant  lifting 
theorem  to  an  H2- space  defined  on  some  Dn  (where  D  denotes  the  unit  disc).  Now  when  one 
applies  the  classical  result  to  Dn  (n  >  2),  even  though  time- invariance  is  preserved,  causality  may 
be  lost.  Indeed,  for  analytic  functions  on  the  disc  D,  time-invariance  implies  causality.  For  analytic 
functions  on  the  n— disc  (n  >  1),  this  is  not  necessarily  the  case.  Consequently,  for  a  dilation 
result  in  H2(Dn)  we  need  to  include  the  causality  constraint  explicitly  in  the  set-up  of  the  dilation 
problem.  We  will  discuss  a  way  of  doing  this  now  based  on  [42,  36,  37]. 


2.1.1  Control  Causal  Commutant  Lifting  Theorem 


We  now  formulate  a  Causal  Commutant  Lifting  Theorem  that  is  suitable  for  control  applications, 
in  particular  the  full  standard  problem. 

For  the  standard  problem  in  robust  control  theory  we  may  extract  the  following  mathematical 
set-up.  We  are  given  complex  separable  Hilbert  spaces  £ii£2}fruJr2  equipped  with  the  unilateral 
shifts  Sgl ,  Sg2 , 5jfx  ,  Sf2 ,  respectively.  Let  ©i  :  £\  — >  T\  be  a  co-isometry  intertwining  Sg1  with  Spx 
(i.e.,  ©iS^  =  5^©i),  and  let  ©2  :  T2  ~ >  £2  be  an  isometry  intertwining  Sg2  with  Sj?2.  We  let  Ug1, 
be  the  minimal  unitary  dilation  of  Sg1  on  /C^,  and  similarly  for  Ug2  on  tCg2y  Ujrx  on  /C.^,  and  Ujr2 
on  /C^-2. 

Now  let 

P%>  :=  (/-S&S£),  P™:=(I-SZ2S%),  n  >  0. 


We  let  the  sequence  pj??  define  the  causal  structure  on  £ 2 ,  and  similarly  the  causal  structure  of 

T2  is  defined  by  the  sequence  pj?\  Moreover,  the  causal  structure  on  £\  is  defined  by  a  general 

sequence  of  operators  P^,  n  >  0,  satisfying  the  standard  causal  structure  conditions  [42],  and 

similarly  the  causal  structure  on  T\  is  defined  by  a  sequence  of  operators  P^n\  n  >  0,  satisfying 
these  conditions  as  well.  We  assume  that  the  input/putput  operators  ©1,  ©2,  are  causal  with 
respect  to  the  above  structures.  We  let  W  :  £ \  — ►  £2  denote  a  causal  operator  intertwining  Sg1 
with  Sg2,  and  let  Q\T\-+  ? 2  be  a  causal  operator  intertwining  with  S?2. 

Define 

f1(n)  :=  (/  -  P[n))£ i,  Vn  >  0, 


and 

Wn  :=  s%w\e{n). 


Moreover,  let 


where 


=  £ {«> 

^  :=  Q  Ug£®  C  KSl,  :=  U£l\S[c). 
i=o 


Finally,  we  define  Wc  :  ►  £2,  by 


W c$  • —  Wn9n, 


for  g  =  Uggn-,  ■€’£{"*,  n  >  0. 

Note  that  we  can  make  a  similar  construction  on  the  spaces  £2)  Pu  In  particular,  for  a  causal 
Q  :  T\  — > ►  T2,  such  that  QS^  =  Sj?2Q}  we  can  define  Qc  :  —>  .F2,  where 

t[co)  :=  0 

j=0 

Next,  it  is  easy  to  see  both  Wc  and  Qc  extend  by  continuity  to  the  closure  respectively 
_  ^r(co)  Clearly,  we  also  have 

M  =  \\W\\,  Wc\£x  =  W,  WcS$  =  Sf2Wc, 
and  || W  -  ©2<?©i||  =  ||(W  -  ©2<3©i)c||-  Now  set 

(a(W,  ©i,  ©2)  :=  inf{||W  —  ©2<3©i||  :  QS^  =  Sf2Q}. 

This  corresponds  to  the  classical  standard  control  problem.  We  also  set 

Mc(W,©i,©2)  :=  inf{||W  -  ©2<3©i||  :  Q  causal,  QSj: x  =  S^Q}. 

This  is  the  causal  standard  control  problem. 

Let  ©i  :  'Ksx  — >  1C ^  denote  the  extension  of  the  co-isometry  ©1  :  £1  — »  T\ ,  that  is  uniquely 
defined  by 

=  £^©!C  1,  Vei€ft. 

Note  that  ©1  is  also  isometric  and  ©1  Usx  =  U^Gi. 

We  can  now  state  the  following  key  result  [38]: 

Theorem  1  (Control  Causal  Commutant  Lifting  Theorem)  Notation  as  above. 

1.  McW©i,e2)  =  n(wc,ei\s[c\e2). 

2.  Qopt  is  a  causal  optimal  solution ,  i.e., 

vc(wyellG2)  =  \\w-G1Qopte2\\ 
if  and  only  if  Qopt}c  is  such  that 

v(Wc, ©i|£jC),  ©2)  =  Wc  ~  ©2Qopt,c© i|5i(c)||. 

Finally,  let  us  recall  how  the  classical  standard  problem  can  be  solved  using  the  commutant 
lifting  theorem.  Set 

Hi  :=  £[c)  ©  (©il^)*^, 

T~L2  :=  £2  ©  ©2*^*2 • 

Let  P  :  £ 2  — >  W2  denote  orthogonal  projection.  Then  we  define  the  operator 

A  =  A(WC,  ©i|£{c\  ©2) :  H\  — ►  W2,  (1) 

by 

Ah  :=  PWch,  he  Hi.  (2) 

Then  using  the  commutant  lifting  theorem,  one  .may  show  that 

||A||=/i(^c,©1|£[c),©2). 

Thus  from  the  above  theorem,  we  have  the  following  result: 
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Corollary  1- -Notation  as  above.  Then 


nc(w,@1,e2)  =  l|A(wc,01|£1(c),e2)||. 


Thus  we  see  that  Theorem  1  and  Corollary  1,  allow  one  to  reduce  a  causal  optimization  problem 
to  one  involving  classical  interpolation. 

This  leads  to  an  explicit  computable  solution  of  the  nonlinear  standard  problem  based  on 
an  iterative  interpolation  procedure.  The  computations  are  based  on  our  previous  skew  Toeplitz 
methodology  that  we  developed  for  distributed  H°°  control.  See  [36,  37,  38]. 

2.2  Saddle  Points,  Game  Theory,  and  Nonlinear  Optimization 

We  have  described  above  a  local  analytic  method  for  nonlinear  system  synthesis.  We  have  also 
been  exploring  a  very  different  approach  applicable  to  certain  systems  with  saturations  (and  “hard” 
noninvertible  nonlinearities)  based  on  a  game-theoretic  interpretation  of  the  classical  commutant 
lifting  theorem  [19].  This  motivates  us  to  formulate  a  nonlinear  commutant  lifting  result  in  such  a 
saddle-point,  game-theoretic  framework. 

A  related  approach  to  nonlinear  design  has  already  been  employed  by  a  number  of  researchers; 
see  [13,  14,  50,  51,  52,  93,  15]  and  the  references  therein.  As  is ’well  known,  game  theoretic  ideas 
have  already  been  extensively  applied  in  linear  H°°  theory.  (See  also  [17]  for  an  extensive  discussion 
of  the  game  theoretic  approach  to  H°°  theory,  as  well  as  a  long  list  of  references  on  the  subject.) 

In  our  research,  instead  of  considering  general  nonlinear  systems  we  have  limited  ourselves  to 
the  concrete  (but  certainly  interesting  case)  of  linear  systems  with  input  saturations.  Such  systems 
are,  of  course,  essential  for  many  practical  applications.  We  should  add  that  a  similar  approach  is 
valid  for  many  of  the  hard,  memoryless,  noninvertible  nonlinearities  which  appear  in  control. 

In  order  to  motivate  our  game-theoretic  approach  to  nonlinear  if00,  we  will  first  give  a  “saddle- 
point”  interpretation  of  the  classical  Sarason  theorem  in  a  special  case.  We  let  w,m  6  H°°  with 
m  inner.  Set  H(m)  H2  ©  mH 2,  we  let  P#(m)  :  H2  H(m)  denote  orthogonal  projection, 
and  S(m)  denote  the  compressed  shift.  We  let  ||  ||  denote  the  2-norm  ||  ||2  on  H 2  as  well  as  the 
associated  induced  operator  norm.  In  [19],  we  prove  that 

inf  sup  \\(w  ~  mq)f\\  —  sup  inf  ||(iu  -  mg)/||  =  sup  inf  \\w  -  mg\\. 

\\f\\<i  ||/|I<1^°°  ll/ll<i^2 

Now  it  is  easy  to  show  there  always  an  optimal  qQ\  see  e.g.,‘[19].  We  now  assume  that 

IK5(m))|U<||^(5(m))||, 

where  ||  \\e3S  denotes  the  essential  norm.  Then  there  exists  fD  e  H2y  \\f0\\  =  1  (a  maximal  vector), 
such  that 


Now 


So 


||(w  -  mq0)(S{m))f0 1|  =  ||u)(5(m))/0||  =  ||u>(5'(m))||  =  ||(w  -  mg0)(S(m))||. 

PH(m)(w  -  mq0)f0  =  (u>  -  mq0)(S(m))f0  =  w(S(m))f0, 

(w  -  mq0)fo  =  w(S(m))f0. 


,||(w  -  mq0)f  ||  <  ||(u>  -  mq0)(S{m))f0\\  =  ||(tz>  -  mqo)f0\\ 
for  all  /  £  H2,  ||/||  <  1.  Moreover, 

|MS(m))/0||  =  ||(w  -  mg)(S(m))/0||  <  \\(w  -  mq)f0\\. . 
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Hence,  we  get-  that 

||(u>  -  mq0)f\\  <  || (u;  -  mq0)f0\\  <  ||(w  -  mq)f0\\  (3) 

for  all  /  e  H 2,  ll/ll  <  1,  and  for  all  q  €  Hx.  It  is  a  nonlinear  analogue  of  the  saddle-point  condition 
(3)  that  we  want  to  analyze  for  saturated  systems.  Indeed,  assuming  the  saddle-point  condition 
(3),  in  [19]  we  derive  all  of  the  standard  consequences  of  the  Sarason  theorem.  Thus  it  is  precisely 
the  existence  of  a  saddle-point  which  we  would  like  to  explore  in  the  nonlinear  setting. 

By  virtue  of  interpretation  of  the  commuting  lifting  theorem  as  asserting  the  existence  of  a 
saddle-point,  we  have  derived  a  global  approach  to  sensitivity  minimization  for  input  saturated 
systems.  Thus  for  ag,  a  saturation  of  magnitude  0  <  1  (see  [19]  for  all  the  precise  definitions), 
and  m  6  H°°  inner,  we  want  to  know  when  there  exist  fa  6  H2,  ||/0||  <  1,  qa  continuous,  causal, 
time-invariant,  such  that 

||(w  -  mag  o  q0)f  ||  <  ||(u;  -  mag  o  g0)/0||  <  ||(u;  -  mag  o  qr)/0|| 

for  all  /  6  H 2,  ||/||  <  1,  q  continuous,  causal,  time-invariant.  Such  a  q0  (when  it  exists)  will 
correspond  to  the  optimal  compensator,  and 

M  :=  \\('w-rn<7e°qo)fo\\ 

will  be  the  optimal  performance  in  the  weighted  sensitivity  minimization  problem.  But  this  is 
equivalent  to  finding  gQ  =  q0(f0 )  €  H 2  such  that 

\\{w  -  muQ  o  q0)f  ||  <  \\w(f0)  -  m<je{g0)\\  <  ||(u;  -  mcre  o  q)f0 ||.  (4) 

Our  approach  then  has  been  to  follow  an  analogous  line  of  reasoning  which  we  just  outlined  in 
our  analysis  of  the  saddle-point  condition  in  the  linear  case.  This  leads  to  nonlinear  commutant 
lifting  theorem  valid  on  a  convex  space  which  can  be  used  to  develop  a  global  robust  design  procedure 
for  nonlinear  plants  with  hard  nonlinearities  [19]. 


2.3  Distributed  Parameter  Systems 

We  have  been  improved  and  extended  our  algorithms  for  the  computation  of  optimal  H°°  controllers 
for  infinite  dimensional  systems.  Our  method  is  based  on  an  explicit  calculation  of  ||/(T)||  with  / 
rational,  where  we  allow  T  to  be  an  arbitrary  contraction  of  class  C.o  [21],  We  will  now  outline  this 
method. 

This  method  has  led  to  a  very  simple  way  of  designing  multivariable  controllers  for  distributed 
multivariable  systems,  and  has  important  implications  for  extensions  to  the  time-varying  case  as 
well.  The  approach  oulined  below  has  been  reported  in  [21]. 


2.3.1  Approximate  Eigenvalues  of  Skew  Toeplitz  Operators 

Let  T  be  a  bounded  operator  on  a  Hilbert  space  H ,  and  let  /(A)  =  p(X)/q(X)  be  a  rational 
function  with  poles  off  the  spectrum  a(T)  of  T,  i.e.,  q( X)  ^  0  for  A  €  cr(T).  Further,  denote 
A  =  f(T)  =  p(T)q(T)~l.  We  will  be  interested  in  the  effective  calculation  of  the  norm  ||j4||  in  the 
case  when  T  is  a  contraction  represented  as  a  functional  model,  and  q  has  no  zeros  in  the  closed 
unit  disk.  However,  some  simple  observations  can  be  made  in  the  general  case.  Thus,  for  instance, 
||A||  is  greater  than  the  spectral  radius  ||A||Sp,  hence 


IMIlsp  =sup| 


9(A) 


:\€a(T)  <  P|| 


Next,  if  p  denotes  ||A||,  then  the  operator  p2I  -  AA*  is  positive  definite  but  not  invertible,  and 
hence  it  has  zero  as  an  approximate  eigenvalue'  Since 


p2I  -  AA*  =  q{T)-\p2q{T)q(T)*-V{T)p{T)*)q{T)*-\ 
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we  deduce  that' the  operator 


Q  =  p2q(T)q(Ty -p(T)p(Ty 

is  positive  definite  and  not  invertible.  If  p( A)  =  Pj^j  an(3  g(A)  =  X^-0gjAJ,  then  Q  can  be 
written  as 

n 

Q  =  £  CijTT*\ 

i,j= 0  • 

where  the  coefficients  =  p2qtqj  ~Pipj  satisfy  the  condition  Cij  =  Cji ,  0  <  i,j  <  n.  Now,  given  an 
arbitrary  polynomial  in  two  variables 


i,i=0 

one  can  introduce  an  operator 


Qu  =  uj(T,T*)  =  Y,  ^TT'i. 

*.i=o 

The  problem  of  deciding  whether  p2I  —  ^4i4*  has  zero  as  an  approximate  eigenvalue  is  equivalent  to 
the  corresponding  question  for  an  operator  of  the  form  Q&  such  that  Cij  =  c^,  0  <  z,  j  <  n.  Since 
the  calculation  of  p  —  ||A||  is  only  a  problem  when  ||A||Sp  <  p,  we  may  restrict  ourselves  to  the 
case  in  which  cj(A,  A)  /  0  for  every  A  e  cr(T). 

In  the  cases  of  interest  in  control,  more  information  is  available  about  T  and  /.  More  precisely, 
T  is  a  contraction  with  inner  characteristic  function,  and  /  belongs  to  the  algebra  H°°  of  bounded 
analytic  functions  in  the  unit  disk  Z>  =  {A  :  |A|  <  1}.  This  means  that  q  has  no  zeros  in  the  closure 
D  of  D)  and  then  von  Neumann’s  inequality  implies  that 

WMsp  =  sup{|/(A)|  :  A  6  a(T)}  <  M  <  sup{|/(C)|  :  |C|  =  1}- 

These  inequalities  become  equalities  if  cr(T)  contains  the  entire  unit  circle  dD  =  {£  :  |£|  =  1}. 
Hence  we  will  assume  throughout  that  a(T)  does  not  contain  the  unit  circle.  We  have  arrived  at 
the  following: 

Distributed  Control  Problem  (DCP):  We  are  given  a  contraction  T  and  a  polynomial  u;(A,  p)  — 
Yaj= o  Ctf  AV  such  that 

(i)  the  characteristic  function  of  T  is  inner; 

(ii)  cr(T )  does  not  contain  the  unit  circle; 

(iii)  Cij  =  Cji ,  0  <  i^j  <  n;  and 

(iv)  lj( A,  A)  ^  0  for  every  A  €  cr(T). 

Determine  whether  zero  is  an  approximate  eigenvalue  of  =  u;(T,T*)  =  ]C£j=o  • 

We  recall  that  the  operators  considered  in  Problem  DCP  are  exactly  the  skew  Toeplitz 
operators  defined  in  [39].  In  [21],  a  new  approach  to  solving  Problem  DCP  is  given.  This  approach 
has  the  appealing  property  that  it  is  extendable  to  time-varying  systems.  See  also  [34]  for  some 
recent  results  as  well  as  a  large  set  of  references  on  time-varying  versions  of  interpolation. 


2.4  Geometric  Evolutions  in  Vision  and  Image  Processing 

In  our  ARO  contract,  we  devoted  a  large  part  of  our  research  work  to  visual  tracking.  This  is 
a  central  area  in  which  the  multivariable  control  methods  developed  over  the  past  twenty  five 
years  could  have  a  major  impact.  In  order  to  successfully  work  on  this  problem,  it  is  essential  to 
incorporate  and  greatly  extend  key  techniques  from  image  processing  and  computer  vision.  We 
have  found  that  the  theory  of  geometric  invariant  flows  is  very  relevant  for  a  number  of  problems 
in  controlled  active  vision.  Interestingly  these  flows  themselves  are  very  much  motivated  by  the 
calculas  of  variations  and  ideas  in  optimal  control ;  see  [59]. 


2.4.1  Background  on  Curve  and  Surface  Evolution 

In  this  section  we  will  review  some  of  the  basic  results  on  curvature  driven  flows.  Full  details  may 
be  found  in  the  very  recent  text  [79].  For  simplicity,  we  will  focus  here  on  the  case  of  planar  curves. 

A  geometric  set  or  shape  can  be  defined  by  its  boundary.  In  the  case  of  bounded  planar 
shapes  for  example,  this  boundary  consists  of  closed  planar  curves.  We  will  only  deal  with  closed 
planar  curves,  keeping  in  mind  that  these  curves  are  boundaries  of  planar  shapes.  A  curve  may  be 
regarded  as  a  trajectory  of  a  point  moving  in  the  plane.  Formally,  we  define  a  curve  C(-)  as  the 
map  C(jp)  :  S1  — ►  R2  (where  S'1  denotes  the  unit  circle).  We  assume  that  our  curves  are  have  no 
self-intersections,  i.e.,  are  embedded. 

We  now  consider  plane  curves  deforming  in  time.  Let  C(p,  t)  :  S1  x  [0,r)  — ►  R2  denote  a  family 
of  closed  embedded  curves,  where  t  parametrizes  the  family,  and  p  parametrizes  each  curve.  Assume 
that  this  family  evolves  according  to  the  following  equation: 


\  C(p,0)=Cb(p) 


(5) 


where  jt  is  the  inward  Euclidean  unit  normal,  T  is  the  unit  tangent,  and  a  and  (3  are  the  tangent 
and  normal  components  of  the  evolution  velocity  V,  respectively.  In  fact,  it  is  easy  to  show  that 
Img[C(p,  t)]  =  lmg[C(w,t)},  where  C(p,  t)  and  C{w,t)  are  the  solutions  of 

Ct  =  ext  -f  pjt  and  Ct  =  [3Af, 


respectively.  (Here  Img[*]  denotes  the  image  of  the  given  parametrized  curve  in  R2.)  Thus  the 
tangential  component  affects  only  the  parametrization,  and  not  Img[*].  Therefore,  assuming  that 
the  normal  component  f3  of  u  (the  curve  evolution  velocity)  in  (5)  does  not  depend  on  the  curve 
parametrization,  we  can  consider  the  evolution  equation 


(6) 


where  (3  =  V  •  N . 

The  evolution  (6)  was  studied  by  different  researchers  for  different  functions  (3.  This  type  of 
flow  was  introduced  into  the  theory  of  shape  in  [56,  57,  58].  One  of  the  key  cases  is  obtained  for 
(3  —  k,  where  k  is  the  Euclidean  curvature: 


(7) 


Equation  (7)  is  called  the  geometric  heat  equation  or  the  Euclidean  shortening  flow ,  since  the 
Euclidean  perimeter  shrinks  as  fast  as  possible  (using  only  local  information)  when  the  curve  evolves 
according  to  (7).  Gage  and  Hamilton  [43]  proved  that  a  planar  embedded  convex  curve  converges 
to  a  round  point  when  evolving  according  to  (7).  Grayson  [45]  proved  that  a  planar  embedded  non- 
convex  curve  converges  to  a  convex  one,  and  from  there  to  a  round  point  from  Gage  and  Hamilton 
result.  For  other  results  related  to  the  Euclidean  shortening  flow,  see  [8,  9,  43,  45]. 
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Another  important  example  is  obtained  when  one  sets  0  =  1  in  equation  (6): 


ac 

dt 


(8) 


This  equation  simulates,  under  certain  conditions,  the  grassfire  flow  [26, 85].  (More  precisely,  the 
unique  weak  solution  of  (8)  which  satisfies  the  entropy  condition  [85]  gives  the  grassfire  flow.)  This 
grassfire  flow  is  also  the  basis  of  the  morphological  scale-space  defined  by  the  disk  as  structuring 
element.  Moreover,  one  can  prove  that  with  different  selections  of  /?,  other  morphological  scale- 
spaces  are  obtained  [59]. 

In  [56,  58],  we  have  studied  the  following  equation  in  order  to  develop  a  hierarchy  of  shape, 
dC 

—  =  {1+€kW.  (9) 

This  equation  was  introduced  by  Osher  and  Sethian  [76]  in  the  level  set  framework.  If  e  —>  0  in 
(9),  the  grassfire  flow  is  obtained,  and  this  introduces  singularities  ( shocks )  in  the  evolving  curve. 
(The  shocks  define  the  well-known  skeleton.)  On  the  other  hand,  if  e  — >  oo,  equation  (9)  reduces 
to  the  classical  Euclidean  curve  shortening  flow,  which  smoothes  the  curve  [86].  The  combination 
of  these  two  opposite  features  gives  very  interesting  properties.  When  a  curve  evolves  according 
to  (9),  the  evolution  of  the  curve  slope  satisfies  a  reaction-diffusion  equation  [89].  The  reaction 
term,  which  tends  to  create  singularities,  competes  with  the  diffusion  term  which  tends  to  smooth 
the  curve.  For  each  different  value  of  e,  a  scale-space  is  obtained  by  looking  at  the  solution  of  (9), 
and  considering  the  time  t  as  the  scale  parameter.  We  have  called  the  set  of  all  the  scale-spaces 
obtained  for  all  values  of  e,  the  reaction- diffusion  scale-space  [56].  In  particular,  we  see  that  the 
Euclidean  shortening  flow  (equation  (7))  defines  an  Euclidean  invariant  scale-space  (the  equation 
admits  Euclidean  invariant  solutions).  In  contrast  with  other  scale-spaces,  like  the  one  obtained 
from  the  classical  linear  heat  equation,  this  one  is  a  full  geometric  scale-space.  The  progressive 
smoothing  given  by  «  is  geometrically  intrinsic  to  the  curve. 

We  now  discuss  the  affine  analogue  of  the  Euclidean  shortening  flow.  (The  affine  group  SA2 
is  the  group  generated  by  unimodular  transformations  and  translations  of  R2.  Under  certain 
natural  conditions,  it  provides  a  good  approximation  to  the  full  group  of  perspective  projective 
transformations.)  Then  in  [73,  80],  we  show  that  the  simplest  non-trivial  affine  invariant  flow  in 
the  plane  is  given  by 

ct  =  Kl/3tf:  (10) 

This  equation  was  introduced  independently  in  [6]  in  the  level  set  framework  where  it  was 
called  the  “fundamental  equation  of  image  processing.”  The  question  now  is  what  happens  when 
a  non-convex  curve  evolves  according  to  (10).  The  following  result  answers  this  question  [10]: 


Theorem  2  Let  C(*,  0)  :  Sl  — ►  R2  be  a  smooth  embedded  curve  in  the  plane.  Then  there  exists  a 
family  C  :  S1  x  [0,  T)  — ►  R2  satisfying 

Ct  =  K1/3.^, 

such  that  C(-,£)  is  smooth  for  all  t  <T,  and  moreover  there  is  a  to  <  T  such  that  for  all  t  >  £0, 
C(-,£)  is  smooth  and  convex. 


Theorem  2  means  that  just  as  in  the  Euclidean  case,  a  non-convex  curve  first  becomes  convex 
when  evolving  according  to  (10).  After  this,  the  curve  converges  to  an  ellipse  from  our  results  in 
[80].  Because  of  this,  and  other  related  properties  (see  [81]),  we  can  conclude  that  equation  (10) 
is  the  affine  analogue  of  (7)  for  smooth  embedded  curves,  and  thus  is  called  the  affine  shortening 
flow .  (It  is  also  the  affine  invariant  formulation  of  the  geometric  heat  equation.)  One  can  use  it  to 
construct  an  affine  invariant  scale-space  for  planar  shapes  [81].  ' 
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2.4.2  Geometric  Active  Contours 

In  this  section,  we  will  describe  a  paradigm  for  snakes  or  active  contours  based  on  principles  from 
curvature  driven  flows  and  the  calculus  of  variations. 

Active  contours  may  be  regarded  as  autonomous  processes  which  employ  image  coherence  in 
order  to  track  various  features  of  interest  over  time.  Such  deformable  contours  have  the  ability  to 
conform  to  various  object  shapes  and  motions.  Snakes  have  been  utilized  for  segmentation,  edge 
detection,  shape  modeling,  and  visual  tracking.  The  books  [24,  79]  contain  excellent  discussions  on 
the  state-of-the-art  of  the  subject. 

In  the  classical  theory  of  snakes,  one  considers  energy  minimization  methods  where  controlled 
continuity  splines  are  allowed  to  move  under  the  influence  of  external  image  dependent  forces, 
internal  forces,  and  certain  contraints  set  by  the  user.  As  is  well-known  there  may  be  a  number  of 
problems  associated  with  this  approach  such  as  initializations,  existence  of  multiple  minima,  and 
the  selection  of  the  elasticity  parameters.  Moreover,  natural  criteria  for  the  splitting  and  merging 
of  contours  (or  for  the  treatment  of  multiple  contours)  are  not  readily  available  in  this  framework. 

In  [55],  we  propose  a  deformable  contour  model  to  successfully  solve  such  problems,  and  which 
will  become  one  of  our  key  techniques  for  tracking.  (A  similar  approach  was  independently  for¬ 
mulated  in  [31,  87].)  Our  method  is  based  on  the  Euclidean  curve  shortening  evolution  (see  Sec¬ 
tion  2.4.1)  which  defines  the  gradient  direction  in  which  a  given  curve  is  shrinking  as  fast  as  possible 
relative  to  Euclidean  arc-length,  and  on  the  theory  of  conformal  metrics.  We  multiply  the  Euclidean 
arc- length  by  a  conformal  factor  defined  by  the  features  of  interest  which  we  want  to  extract,  and 
then  we  compute  the  corresponding  gradient  evolution  equations.  The  features  which  we  want 
to  capture  therefore  lie  at  the  bottom  of  a  potential  well  to  which  the  initial  contour  will  flow. 
Moreover,  our  model  may  be  easily  extended  to  extract  3D  and  4D  surfaces  based  on  motion  by 
mean  curvature  [55,  64]. 

The  starting  point  of  this  work  is  [30,  67]  in  which  a  snake  model  based  on  the  level  set 
formulation  of  the  Euclidean  curve  shortening  equation  is  proposed.  More  precisely,  the  model  is 

^-«x,»)|V®||(dW(^J)  +  .).  (11) 

Here  the  function  <f>(x,y)  depends  on  the  given  image  and  is  used  as  a  “stopping  term.”  For 
example,  the  term  </>(x,  y)  may  chosen  to  be  small  near  an  edge,  and  so  acts  to  stop  the  evolution 
when  the  contour  gets  close  to  an  edge.  One  may  take  [30,  67] 


where  I  is  the  (grey-scale)  image  and  Ga  is  a  Gaussian  (smoothing  filter)  filter.  The  function 
^(x,  y,  t)  evolves  in  (11)  according  to  the  associated  level  set  flow  for  planar  curve  evolution  in  the 
normal  direction  with  speed  a  function  of  curvature  which  was  introduced  in  [76,  85,  86], 

It  is  important  to  note  that  the  Euclidean  curve  shortening  part  of  this  evolution,  namely 


d *  ,  V*  . 

*  =  l|v*l|d,v(jjW 


is  derived  as  a  gradient  flow  for  shrinking  the  perimeter  as  quickly  as  possible.  As  is  explained 
in  [30],  the  constant  inflation  term  u  is  added  in  (11)  in  order  to  keep  the  evolution  moving  in 
the  proper  direction.  Note  that  we  me  taking  ^  to  be  negative  in  the  interior  and  positive  in  the 
exterior  of  the  zero  level  set. 

We  would  like  to  modify  the  model  (11)  in  a  manner  suggested  by  the  curve  shortening  flow. 
We  change  the  ordinary  arc-length  function  along  a  curve  C  —  (x(p),  y(p))T  with  parameter  p  given 

by 

ds  =  {xl  +  y%)1/2dp, 
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ds<t>  =  ( xl  +  y%)1/24>dp , 

where  <f>(x,y)  is  a  positive  differentiable  function.  Then  we  want  to  compute  the  corresponding 
gradient  flow  for  shortening  length  relative  to  the  new  metric  ds#.  Setting 

and  taking  the  first  variation  of  the  modified  length  function  L^,  and  using  integration  by  parts 
(see  [55]),  we  get  that 

,  /•£*( 0  fic  - 

L<j>(t)  =  ~  -  (V<f>  ■  J\f)tf)ds 

which  means  that  the  direction  in  which  the  L $  perimeter  is  shrinking  as  fast  as  possible  is  given 
by 


—  =  {<j)K  -  (V0  •  .  (14) 

This  is  precisely  the  gradient  flow  corresponding  to  the  miminization  of  the  length  functional  1$. 
The  level  set  version  of  this  is 

_  =  ^||  V^||div(|p^i| )  -+-  •  V^.  (15) 

One  expects  that  this  evolution  should  attract  the  contour  very  quickly  to  the  feature  which  lies 
at  the  bottom  of  the  potential  well  described  by  the  gradient  flow  (15).  As  in  [30,  67],  we  may  also 
add  a  constant  inflation  term,  and  so  derive  a  modified  model  of  (11)  given  by 

dV  V# 

“ft  =  # V^IKdiv(jjv^j|  ^ )  +  u)  +  V<t>  *  V*-  (16) 

Notice  that  for  <j>  as  in  (12),  V<£  will  look  like  a  doublet  near  an  edge.  Of  course,  one  may  choose 
other  candidates  for  <j>  in  order  to  pick  out  other  features. 

We  now  have  very  fast  implementations  of  these  snake  algorithms  based  on  level  set  methods 
[76,  85].  Clearly,  the  ability  of  the  snakes  to  change  topology,  and  quickly  capture  the  desired 
features  will  make  them  an  indispensable  tool  for  our  visual  tracking  algorithms.  See  also  [92]  for 
more  details  about  this. 

We  are  also  studying  an  affine  invariant  snake  model  for  tracking  based  on  our  work  in  [75]. 
(The  evolution  itself  works  using  a  level  set  model  of  as  discussed  in  Section  2.4.1.)  We 

have  developed  affine  invariant  volumetric  smoothers  in  [74],  and  have  employed  affine  smoothers 
in  movies  as  a  preprocessing  tool  for  motion  estimation.  We  are  now  working  on  the  incorporation 
of  more  global  information  for  the  active  contours  as  well  as  utilizing  Bayesian  statistical  models. 

2.4.3  Invariant  Flows 

In  this  section,  we  will  summarize  some  of  our  recent  work  on  the  classification  of  invariant  ge¬ 
ometric  flows.  It  is  interesting  to  note  how  the  calculus  of  variations  and  thus  optimal  control 
type  techniques  plays  such  a  fundamental  role  in  solving  this  problem.  This  is  based  on  our  work 
reported  in  [74]. 

Consider  the  evolution  of  hypersurfaces  which  are  assumed  to  be  represented  by  the  graph 
of  a  function.  We  let  the  p  +  1-dimensional  Euclidean  space  E  ~  Rp  x  R,  with  coordinates 
x  =  (x1, . . .  ,xp)  representing  the  independent  variables,  and  u  €  R  the  dependent  variable. 
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The  hypersurfate  S  C  E  will  be  identified  with  the  graph  of  a  function  u(x),  defined  on  a  domain 
x  G  D  C  Rp.  The  symmetry  group  G  will  be  a  finite-dimensional,  connected  transformation  group 
acting  on  E.  Each  group  transformation  g  e  G  will  map  hypersurfaces  to  hypersurfaces  by  point- 
wise  transformation. 

In  Lie’s  theory  of  symmetry  groups,  one  replaces  the  actual  group  transformations  by  their 
infinitesimal  generators,  which  are  vector  fields  on  the  domain  E ,  taking  the  general  form 


d  3  3 

v  =  s{x'u)di + = + ' 


.3  ,  .  d 


(17) 


Each  vector  field  generates  a  local  one-parameter  group  of  transformations  (or  flow)  on  E,  obtained 
by  integrating  the  associated  system  of  ordinary  differential  equations 


^ ^=<p(x,u),  (is) 

where  e  represents  the  group  parameter.  In  other  words,  the  group  transformations  have  the  Taylor 
expansion 


x(e)  =  x  +  (x,  u)  -t - ,  u(e)  =  u  +'  eip{x,  u)  - \ - .  (19) 

The  order  e  terms  in  (19)  are  known  as  the  infinitesimal  group  transformations ,  and  can  be  identified 
with  the  generating  vector  field  (17).  The  different  one-parameter  groups  combine  to  generate  the 
entire  connected  group  action  of  G . 

Fixing  the  vector  field  (17),  let  u(x,e)  denote  the  one-parameter  family  of  hypersurfaces  (func¬ 
tions)  obtained  from  a  given  hypersurface  u(x,0)  =  u(x)  by  applying  the  group  transformation 
with  parameter  e.  The  infinitesimal  change  in  the  hypersurface  is  found  by  expanding  in  powers  of 
£  using  Taylor’s  Theorem  and  the  chain  rule.  Thus,  the  value  of  the  transformed  function  u  at  the 
new  point  x(e)  is  given  by 

u(x(e),£)  =  u(x)  +etp(x,u(x))  - .  (20) 

On  the  other  hand,  if  we  are  interested  in  the  value  of  the  transformed  function  at  the  original 
point  x  =  x(0),  we  substitute  (19)  into  (20)  to  deduce  the  alternative  expansion 

u(x ,  e)  =  u(x)  -{-  eQ[u(x)\  H - .  (21) 

The  function 


Q[u]  =  <p(x, u)  - 


i=l 


3xx 


(22) 


is  known  as  the  characteristic  of  the  vector  field  (17).  The  characteristic  Q  depends  on  first  order 
derivatives  U{  =  3u/3xx  because  the  group  transformations  are  acting  oh  the  independent  variables 
x  as  well  as  the  dependent  variable  u .  In  particular,  a  G-invariant  hypersurface  is  independent  of 
the  group  parameter  e,  and  hence  satisfies  the  first  order  partial  differential  equation  Q(z,  u^)  =  0, 
indicating  its  “infinitesimal  invariance”  under  the  vector  field  v.  Conversely,  any  infinitesimally 
invariant  function,  i.e.,  any  solution  to  the  characteristic  equation  Q  =  0,  is,  in  fact,  invariant  under 
the  entire  connected  transformation  group. 

Consider  the  function  F[u]  =  F(x,u^)  depending  on  x,  u,  and  the  derivatives  of  u,  denoted 
by  uj  =  Dju.  Here  Dj  =  DjxDj2  Djk  are  the  total  derivative  operators,  which  differentiate 
treating  u  as  a  function  of  x.  The  infinitesimal  variation  in  the  function  F[u]  under  the  group 
generated  by  the  vector  field  v  is  then  given  by 


d_ 

de 


F[w(a:,e)] 


£=0 


(23) 
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In  (23)  we  evaluate  F  and  u  at  the  original  point  x.  If  we  are  interested  in  the  value  at  the 
transformed  point  x(e),  we  must  include  an  additional  term  arising  from  the  change  of  independent 
variable,  as  in  the  passage  from  (21)  to  (20).  We  deduce  the  expansion 

F{x(e),u{n\x,e))  =  F(x,u(n))  +  sprv(F)  +  --.,  (24) 

where 

dF 

pr  v(F)  =  Ylfa-JDjQ  +  Y, ?D<F  (25) 

J  i 

defines  the  “prolongation”  of  the  vector  field  v,  denoted  pr  v,  which  forms  the  infinitesimal  generator 
of  the  prolonged  group  action  on  the  space  of  derivatives. 

A  function  F(x)u^)  is  called  a  differential  invariant  if  its  value  is  not  affected  by  the  group 
transformations.  Thus  we  require  that  the  left  hand  side  of  (24)  be  independent  of  e.  The  infinites¬ 
imal  invariance  condition  is  obtained  by  differentiating  with  respect  to  e.  This  produces 

&ip 

0  =  pr  V(F)  =  dP~,DjQ  +  5Z ?DiF-  (26) 

J  J  i 

Condition  (26),  for  v  an  arbitrary  infinitesimal  generator  of  G,  is  necessary  and  sufficient  for  F  to 
be  a  differential  invariant. 

A  transformation  group  G  is  called  a  symmetry  group  of  a  differential  equation 

F(x,u(n))  =  0  (27) 

if  it  maps  solutions  to  solutions.  The  differential  equation  (27)  admits  G  as  a  symmetry  group  if 
and  only  if  the  infinitesimal  invariance  condition 

pr  v[F]  =0  whenever  F  =  0  (28) 

holds  for  all  infinitesimal  generators  of  G. 


Invariant  Hypersurface  Flows: 

The  goal  is  to  determine  the  general  form  that  a  G-invariant  evolution  equation 


ut  =  K{x,u (n))  (29) 

must  take.  Here  we  have  introduced  an  additional  variable  t  —  the  time  or  scale  parameter  — 
which  is  not  affected  by  our  group  transformations. 

Thus,  for  p  =  1,  we  will  determine  all  possible  invariant  curve  evolutions  in  the  plane  under  a 
given  transformation  group,  while  for  p  =  2  we  find  the  invariant  surface  evolutions.  According  to 
(25),  the  infinitesimal  change  in  the  t-derivative  of  u  at  the  transformed  point  is 


de 


ut{x,t,e) 


£=0 


—  DtQ  +  ^2  £lDiut  =  Qu^t, 


*=i 


(30) 


where 


_  dQ  _  dy  du 

u  du  du  "  du  dx r 

t—i 


(31) 


Therefore,  using  the  infinitesimal  condition  (28),  and  substituting  for  ut  according  to  the  equation 
(29),  we  deduce  the  basic  invariance  condition  that  an  evolution  equation  must  satisfy  in  order  to 
admit  a  prescribed  symmetry  group. 
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Lemma  1  A.  connected  transformation  group  G  is  a  symmetry  group  of  the  evolution  equation 
Ut  =  K[v]  if  and  only  if  the  infinitesimal  condition 

pr  v{K)  =  QUK  (32) 

holds  for  every  infinitesimal  generator  v  of  the  group  G  with  associated  characteristic  Q. 


To  discover  a  G-invariant  evolution  equation  for  an  arbitrary  group,  we  consider  the  G-invariant 
functionals.  An  n-th  order  variational  problem  consists  of  finding  the  extremals  (maxima  or  min¬ 
ima)  of  a  functional 


Cd[u]=  [  L(x,u^)dx=  [  L(x,  u^)  dxl  A  ...  A  dxp, 
Jd  Jd 


(33) 


subject  to  certain  boundary  conditions. 

The  integrand  L[u]  =  L(xiu^)1  known  as  the  Lagrangian ,  is  a  smooth  function  depending  on 
x)  u  and*  the  derivatives  of  u.  A  transformation  group  G  is  a  symmetry  group  of  a  variational 
problem  provided  it  leaves  the  functional  (33)  invariant. 

More  precisely,  given  a  function  u(x)  defined  on  a  domain  D,  and  a  one-parameter  subgroup 
of  G,  we  let  u(x,s)  denote  the  transformed  function,  which  is  defined  on  a  transformed  domain 
D(e).  Invariance  of. the  functional  requires  that  CD^)[u(x,e)]  =  Cd[u(x)\.  Using  the  standard 
Jacobian  change  of  variables  formula  for  multiple  integrals,  the  infinitesimal  invariance  condition' 
is  then  found  by  differentiating: 


0  =  —cm[u{x,e)\ 


£=0 


d  f 

—  —  /  L[u(x(e))e)}  det 

as  Jd 

=  J  [pr  v(L)  -f  Ldiv  £]  dx  . 


~dx(eY 

dx 

dx 

£— 0 


(34) 


Here  div  £  =  £  D^1  is  the  total  divergence  arising  from  the  infinitesimal  change  in  the  independent 
variables. 


Lemma  2  A  connected  transformation  group  G  a  symmetry  group  of  the  variational  problem  f  Ldx 
if  and  only  if  every  infinitesimal  generator  v  satisfies  the  infinitesimal  condition 

pr  v(L)  +  L  div  £  =  0.  (35) 

The  smooth  extremals  (maxima  and  minima)  of  a  variational  problem  are  known  to  satisfy  the 
classical  Euler-Lagrange  equation, 

E(L):=  £  (~D)j  =0,  a  =  l,...,q.  (36) 

#J=0  OUJ 

where  ( ~D)j  —  {—Djx)(—Dj2)  ■  ■  •  (—Djk)  is  the  signed  total  derivative.  This  condition  is  the 
infinite-dimensional  analog  of  the  vanishing  gradient  condition  for  maxima  and  minima  of  ordinary 
functions.  The  Euler-Lagrange  equation  is  obtained  by  taking  the  variational  derivative  of  the 
functional.  For  example,  if  C  represents  the  G-invariant  arc-length  or  surface  area  functional,  the 
Euler-Lagrange  equation  will  describe  the  G-invariant  minimal  curves  or  surfaces.  In  general,  the 
invariance  of  a  variational  problem  under  a  given  transformation  group  implies  the  invariance  of  its 
Euler-Lagrange  equation.  (The  converse,  however,  is  not  true.)  We  will  be  interested  in  precisely 
how  the  Euler-Lagrange  equation  varies,  and  this  is  the  result  of  the  following  key  lemma. 
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Lemma  3  Let pr  v  be  the  prolonged  vector  field  (25).  Let  L(x,u^)  be  a  Lagrangian.  Then 

E( pr  v(L)  +  Ldiv  0  =  pr  v(E(L))  +  (Qu  +  div  £)E(L).  (37) 


Prom  this,  we  can  construct  invariant  evolution  equations.  Suppose  that  L  is  a  G-invariant 
Lagrangian,  e.g.,  defining  the  group  invariant  arc  length  or  area.  Then  L  satisfies  the  infinitesimal 
invariance  condition  (35),  and  hence  (37)  implies  the  identity 


pr  v[E(L)\  +  (div  £  4-  QU)E(L)  =  0.  (38) 

Equation  (38)  means  that  E(L)  is  a  relative  differential  invariant  of  weight  —div  £  —  Qu.  In 
particular,  the  Euler-Lagrange  equation  E(L)  —  0  is  invariant  under  G,  as  claimed.  On  the  other 
hand  L  itself  is  a  relative  invariant  of  weight  —div  £.  Since  the  prolonged  vector  field  pr  v  acts  as 
a  derivation,  the  ratio  E(L)/L  is  a  relative  differential  invariant  weight  - Qu ,  i.e.,  it  satisfies 


pr  v 


E(L) 


+  Qu 


E(L) 


=  0. 


(39) 


Consequently,  its  reciprocal  L/E(L)  (assuming  E(L)  ^  0)  satisfies  (32)  and  defines  a  G-invariant 
evolution  equation.  We  have  therefore  deduced  our  fundamental  theorem  from  [74]: 

Theorem  3  Let  G  be  a  transformation  group ,  and  let  Ldxbe  a  G-invariant  Lagrangian  with  non- 
identically  zero  Euler-Lagrange  derivative  E(L).  Then  every  G-invariant  evolution  equation  has 
the  form 


ut  = 


.  L 
E(L) 


where  I  is  a  arbitrary  differential  invariant  of  G. 


(40) 


Although  (40)  defines  the  most  general  class  of  invariant  evolution  equations,  the  case  when 
the  differential  invariant  I  is  constant  is  not  necessarily  the  simplest  one.  In  the  planar  Euclidean 
case,  L  =  i/l  +  u**  is  the  Euclidean  arc  length  Lagrangian,  so  that 


E{L)  =  ~DX~  = 
OUx 


— K. 


(1  +  u|)3/2 

Thus  the  general  Euclidean-invariant  evolution  equation  has  the  form 
I 


ut 


where  I  is  an  arbitrary  function  of  k  and  its  arc  length  derivatives.  Choosing  I  =  k  produces  the 
simplest  one  (eikonal  equation),  while  I  =  k2  produces  the  Euclidean  curve  shortening  flow. 

One  can  also  deduce  the  following: 


Proposition  1  Suppose  G  is  a  connected  transformation  group ,  and  Ldx  a  G-invariant  p-form 
such  that  E(L)  7^  0.  Then  E(L)  is  a  differential  invariant  if  and  only  if  G  is  volume-preserving. 

Corollary  2  Let  G  be  a  connected  volume  preserving  transformation  group.  Then ,  up  to  constant 
multiple,  the  G-invariant  flow  of  lowest  order  has  the  form 

ut  =  L,  :  (41) 

where  uj  =  Ldx 1  A  ...  A  dxp  is  the  invariant  p-form  of  minimal  order  such  that  E(L)  ^  0. 
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Affine  Invariant  Surface  Flows: 

We  apply  the  preceding  results  to  describe  the  simplest  possible  affine  invariant  surface  evolu¬ 
tion.  This  gives,  for  convex  surfaces,  the  surface  version  of  the  affine  shortening  flow  for  curves. 
The  group  G  is  the  (special)  affine  group  SL(3,  R),  consisting  of  all  3  x  3  matrices  with  determinant 
1,  combined  with  the  translations.  Let  S  be  a  smooth  strictly  convex  surface  in  R^,  which  we  write 
locally  as  a  graph  u  =  u(x ,  y). 

The  simplest  affine-invariant  area-form  is  constructed  from  the  affine-invariant  metric,  which  is 
given  by  [74] 

Ldx  Ady  =  u*  +  u*  dx  A  dy , 

where 

__  UXxUyy  “  U%.y 

*"(l+^  +  u2)2  ’ 

denotes  the  usual  Gaussian  curvature  of  S .  Corollary  2  allows  us  to  conclude: 

Corollary  3  Up  to  constant  multiple ,  the  simplest  affine-invariant  evolution  equation  has  the  form 
ut  =  Klliyjl+ul+u2y.  (42) 
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